Hidden Errors in Simulations and the Quality of Pseudorandom Numbers 



In a recent letter Ferrenberg et al. (FLW) [1] present intriguing results arising from 

combinations of some random number generators and Monte Carlo acceleration 

algorithms. In particular, they observe systematic errors when the Wolff algorithm 

~tr}~ • [2] is used at T c in the 2 — d Ising model. As an explanation of this, they propose 

Q\ ' 

Q\ ■ that subtle correlations arise in the random number sequences, in the sense that 

t— i ■ 

Ch ■ the higher order bits of the random numbers are correlated. 

a 

We have recently carried out extensive statistical, bit level, and visual tests for 

several commonly used pseudorandom number generators in physics applications 
t~ i 

. [3]. Two of these were used in Ref. 1, namely R250 [4] and CONG [5]. Using the 

(N . . 

Wolff algorithm FLW discovered problems with R250, but not with CONG. Thus, 



our test results bear direct relevance to the existence of possible problems, and 
differences between these two algorithms. 
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To directly probe the correlations between each bit of consecutive pseudorandom 
numbers, we have performed two quantitative tests. The first one is an extended 

O 

version of the m-tuple test [6] . The second test was based on the range of binary 
random matrices [7]. In Table 1 we present a summary of the results for each 
of the 31 significant bits from random numbers generated by R250 and CONG. 
Our results indicate no bit level correlations in CONG. The same is true for R250, 
provided it is properly initialized. This is demonstrated in Table 2, where R250 
was initialized by a lagged Fibonacci generator RAN3 [8], which contains several 
correlated bits, including five of the most significant ones. As seen in the results, 
correlations from RAN3 transform into R250. 

Our results thus indicate that the problems observed in Ref. 1 have no simple 
explanation in terms of bit level correlations. We note that both R250 and CONG 
were also subjected to an array of statistical tests [3,5], in which neither of them 
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showed any particular weaknesses. However, our 2 — d visual tests did reveal a 
periodic spatial fine structure in CONG, a result not unexpected with this type of 
algorithm [3]. Yet, no problems with CONG were reported by FLW. Since their 
results presently have no clear explanation, we wholeheartedly agree with them 
on the importance of careful physical tests [3] before a particular "good quality" 
generator is chosen for simulations. 
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Table Captions: 



Random 


Failing bits 


Failing bits 


number 


in the 


in the 


generator 


m-tuple test 


random matrix test 


R250 


none 


none 


CONG 


none 


none 



Table 1. The results of an extended m-tuple test with parameters 
to = t = 3, and a test using 2x2 random matrices. In these 
tests R250 was initialized by CONG. 



Random 

number 

generator 


Failing bits 

in the 
m-tuple test 


Failing bits 
in the 
random matrix test 


R250 
RAN3 


1 - 2, 27 - 31 
1 - 5, 25 - 30 


1, 27 - 31 
1 - 5, 26 - 30 



Table 2. The results of bit level tests for R250 initialized by RAN3. 
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